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SOFTWARE CRITICAL TO NASA SHUTTLE 
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- Formal Board Structure 

- Documents Requirements and Design Baselines 
-Stored in Configuration Management Data Base 
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ORIGINAL' PAGE T3 
OF POOR QUALITY 







IN LESS-CRITICAL MISSION PHASES (ON-ORBIT) 

— MULTIPLE PASS OPERATIONAL PROGRAMS EXECUTE IN 2 OR 3 GPC’s 

— REMAINING GPC’s ARE POWERED-OFF 



REDUNDANT GPC SETS 
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simultaneous data access. 
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PRIMARY AVIONICS SOFTWARE SYSTEM FUNCTIONS 
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Users Of On-board Shuttle Flight Software 
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THERE ARE NINE PLACES WHERE ON-BOARD PRIMARY SOFTWARE 
DEVELOPED FOR THE SPACE SHUTTLE MAY BE IN USE: 

o VEHICLE IN ORBIT 

o VEHICLE AT CAPE CANAVERAL PREFLIGHT (KSC) 

o VEHICLE AT EDWARDS AFB POSTFLIGHT 

o SHUTTLE MISSION SIMULATOR (SMS) 

o SHUTTLE AVIONICS INTEGRATION LABORATORY (SAIL) 

o SOFTWARE DEVELOPMENT FACILITY (SDF) 

o SOFTWARE PRODUCTION FACILITY (SPF) 

o NEW ORBITER UNDER CONSTRUCTION AT PALMDALE 
o VEHICLE AT YANDENBERG AFB PREFLIGHT (VLS) 
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SOFTWARE CRITICAL TO NASA SHUTTLE 
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SHUTTLE ONBOARD SOFTWARE ORGANIZATION 
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SOFTWARE DEVELOPMENT 
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SHUTTLE AVIONICS SOFTWARE LEVELS OF TESTING 
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CONFIGURATION MANAGEMENT DATA BASE 
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CLUDING A LISTING TAPE OF ALL BUILT CHANGES 
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TEST AND OPERATIONS ORGANIZATION INTERFACES 




XB/W PROBLEM Sl/AGMoSf S 


SIMULATIONS 
AND TRAINING 




IN FLIGHT 
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DISPLAYS (Photos) M 
VERBAL DESCRIPTIONS 
VEHICLE DYNAMICS 
LOG OF KEYBOARD INPUTS 
MEMORY DUMPS 
TELEMETRY DOWNLIST 
CONSOLE LOGS 
TABULAR PARAMETRIC DATA 
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VERIFICATION 
AND TESTING 
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RESOLUTION 


MATRIX OF 
EXPERTISE 


SPACE SHUTTLE PROGRAMS 



1. QUESTION THE WITNESS 
- WHAT DID HE OBSERVE 





DETERMINE FLIGHT SCENARIO 
SURROUNDING PROBLEM 

MEMORY CONFIGURATION 
MANEUVERS EXECUTED 
KEYSTROKES ENTERED 
FAILURES EXPERIENCED 


2 engine 


fai lures 


Umts Of Onboard Shuttta Fight Software 


3. SEARCH FOR USERS WITH 
SIMILAR SYMPTOMS 
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USE APPROPRIATE DIAGNOSTIC TECHNIQUES 


• PROGRAM CROSS REFERENCE 

• MAGNIFIED TIMELINES 

• CAUSE AND EFFECT GRAPHS 

t CYCLIC/MULTIPASS EVALUATIONS 

• TRAP PATCHES/TRACES 

t PROCESS DESENSITIZATION 

• COMMON DENOMINATOR DETERMINATION 

> EVALUATE FSW RESPONSE TO HYPOTHESIZED INPUTS 

• CODE WALK-THROUGH/MENTAL INSPECTION 

• EXECUTION TEST 

• REVISE HYPOTHESIS 

• CHALLENGE ASSUMPTIONS 
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OF POOR QUALITY 


PROBLEM 

SYMPTOMS 

REPORTED 


DEFINITION OF PROBLEM 


FACT 

FINDING 


• "WHAT IS THE PROBLEM" • (DIRECTLY CONTACT WITNESS) 

• THE SCENARIO WHICH LEO TO THE PROBLEM ANO THE 
ENVIRONMENT, SYSTEM. ANO FSW CONFIGURATIONS 

- FAULTS. FAILURES ENCOUNTERED 

- EXTERNAL STIMULI 

- SOFTWARE VERSION 

- SOFTWARE ALTERATIONS APPLIED 

• WHETHER OTHER USERS EXPERIENCED SIMILAR SYMPTOMS 

• THE "CORRECT" SOFTWARE RESPONSE TO THE CONDITIONS 
ENCOUNTERED (REVIEW REQUIREMENTS) 


00 \ 
REQUIREMENTS 
COVER THESE 
V CONDITIONS > 


ASSIGN TO 
REQUIREMENT 
REVIEW TEAM 


SOFTWARE 
RESPONSE 
.CORRECT . 


PROBLEM \ X / 

RECONSTRUCTION VC 

r- — ~ l>^ 


EDUCATE 
THE USER 


REITERATE 


SEARCH 

FOR 

SUSPECT- 
UNIT OF COOi 


XoutputS, 

/ SYMPTOM 
AN EFFECT OF A 
„ SYMPTOMATIC 
\ INPUT TO 
\ THAT > 
\COOE.X 


YES • ** ^ 

hX ROOT problem 
RECOGNIZABLE 


APPLY 

SPECIAL 

TECHNIQUES 


/ mas 

SYMPTOM— 

^CAUSING SCENARIO ^. 

. 866N /■! 

^RECONSTRUCTED / 


RE-EVALUATION 
OF PROBLEM 
HYPOTHESES 


INTERPRET 
RESULTS 
OP DIAGNOSTIC 
TESTS 


ISOLATION OF PROBLEM AREAS 


• IDENTIFY THE MOST "IMMEDIATE" SOFTWARE SYMPTOM 
(E.G.. FLAG TURNEO OFF. VALUE WRONG....) 8ASE0 ON 
CURRENT UNDERSTANDING ANO DATA 

• ISOLATE SOFTWARE PROCESS. (THE "SUSPECT UNIT OF 
CODE") WHICH PROOUCED THE IMMEDIATE SYMPTOM 

• INSPECT CODE WITHIN SUSPECT UNIT FOR CAUSE OF 
IMMEDIATE SYMPTOM 


INVESTIGATION 


• PERFORM APPROPRIATE DIAGNOSTIC TECHNIQUES 
(EACH IS OPTIONAL) 

- PROGRAM CROSS-REFERENCE 

- MAGNIFIED TIMELINES 

- CAUSE ANO EFFECT GRAPHS 

- CYCLIC OR MULTI-PASS EVALUATIONS 

- "TRAP" PATCHES OR TRACES 

- PROCESS OESENSITIZATION TO 
SELECTED INPUTS 

- COMMON DENOMINATOR DETERMINATION 

• EVALUATE CODE UNIT RESPONSE TO INPUTS 


INTERPRETATION OF CLUES 

• RESULTS OF APPLICATION OF DIAGNOSTIC 
TECHNIQUES REVIEWED 

- FOR NEW CLUES 

- FOR INTERMEDIATE SYMPTOMS 


RE-EVALUATION OF THEORIES 

• CHALLENGE ASSUMPTIONS PREVIOUSLY USCO TO ELIMINATE 
ALTERNATE EXPLANATIONS 

• OEFlNE INPUTS TO SUSPECT SOFTWARE UNIT OR "STRESSEO 
CONDITIONS" THOUGHT TO HAVE PROOUCEO IMMEDIATE 
SYMPTOMS (HYPOTHESIZE A SCENARIO) 

• APPLY THE HYPOTHESIZED INPUTS OR SCENARIO TO SUSPECT 
COOE (TEST CASE. EXECUTION OR MENTAL CODE - WALK - 
THRU) 

• SEARCH FOR LATENT (PREVIOUSLY UNRECOGNIZED) 
SIGNATURES OF THESE ALTERNATE EXPLANATIONS 


PROBLEM 

RESOLUTION 


MAKE R ECOMM ENOAT ION 
FOR SOLUTION 

- MOOIFY CODE 

- OOCUMENT PROBLEM 
ANO WORK- A ROUNDS 



SOLUTION 


> EXACTLY, "WHAT IS THE ROOT PROBLEM"? 

i WHAT OTHER FACTORS CAUSE PROBLEM TO 116 MANIFESTED? 
i WHAT OTHER EFFECTS CAN THIS PROBLEM PHOOUCE? 

» IMPLICATIONS TO USER. ANO AVAILABLE WORK-AROUNDS 
DETERMINED 

► IMPACT TO CORRECT THE PROBLEM IN COOE DETERMINED 
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TRACTOR AND BY IBM (CALLED CERTIFICATION) 



NOMINAL (IDEAL) PASS DEVELOPMENT AND RECONFIGURATION ACTIVITY 
"OPERATIONAL INCREMENT PLAN / FLT-TO-FLT RECONFIGURATION PLAN" 
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RESULTS OF ALL DISCREPANCY OVERSIGHT ANALYSES REVIEWED QUARTERLY WITH 
CONTRACTOR AND NASA MANAGEMENT 

— DISCREPANCY "ESCAPE/DETECTION” HISTORY PRESENTED (ANALYZED) 




IBM OBS QUALITY MEASUREMENT DEFINITIONS 

v % = number of major inspection errors 
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SOFTWARE QUALITY AND PRODUCTIVITY MEASUREMENTS 
RECONFIGURATION ERRORS PER RELEASED SYSTEM 





SOFTWARE QUALITY AND PRODUCTIVITY 



B Number of Shuttle Missions Per Year 
£2 Elapsed Time to Reconfigure Software in Weeks 
m ENort Expended Per Flight in Person Years 
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SOFTWARE QUALITY AND 
PRODUCTIVITY MEASUREMENTS 



Industry IBM FSD Houston 
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SOFTWARE CRITICAL TO NASA SHUTTLE 
ONBOARD SHUTTLE SOFTWARE DEVELOPMENT 



Software Build/lntegralion 




SOFTWARE DEVELOPMENT/PRODUCTION FACILITY FLIGHT SIMULATOR 
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ACRONYMS 
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ACRONYMS 


BCLMAKER 

BFS 

BFSPLP 

CCB 

Cl 

CIP 

CITE 

CLASS 1 

CMC 

CMDB 

CPU 

CR 

CSECT 

DBA 

DCCB 

DCR 

DDRB 

DL OR D/L 

DIP 

DPSD 

DR 

DSN 

FACI 

FCCB 

FEID 


BUILD CONTROL LIST MANAGER 

BACKUP FLIGHT SYSTEM 

BFS PAYLOAD PREPROCESSOR 

CONFIGURATION CONTROL BOARD 

CONFIGURATION INSPECTION 

CLASS 1 INTEGRATION PLAN 

CARGO INTEGRATION TEST EQUIPMENT 

FSW CAPABILITY UPDATE 

CONFIGURATION MANAGEMENT & CONTROL 

CONFIGURATION MANAGEMENT DATA BASE 

CENTRAL PROCESSING UNIT 

CHANGE REQUEST (Used Interchangeably With SCR) 

CONTROL SECTION 

DATA BASE ADMINISTRATOR 

DATA CONFIGURATION CONTROL BOARD 

DATA CHANGE REQUESTS 

DEVELOPMENT DISCREPANCY REVIEW BOARD 

DOWN LIST 

DOWNLIST PREPROCESSOR 
DATA PROCESSING SYSTEM DIVISION 
DISCREPANCY REPORT FOR FSW 
DATA SET NAME 

FIRST ARTICLE CONFIGURATION INSPECTION 
FACILITIES CHANGE CONTROL BOARD 
FLIGHT EQUIPMENT INTERFACE DEVICE 


A-2 




ACRONYMS 



FIPS 

FRF 

FSW 

GFE 


C 


GMEM 

GTl 

HDW 

HSM 

IBCB 

IBM 

IDRB 

IDS 

ILORI/L 

IMRB 

IMS 

JES 

JSC 

KSC 

L6 

L7 

18 

MAST 

MCC 

MDBINIT 

MIP 

MM 

MMI 


FLIGHT LOAD PREPARATION SYSTEM 

FLIGHT READINESS FIRING 

FLIGHT SOFTWARE 

GOVERNMENT FURNISHED 
EQUIPMENT/INFORMATION 

GENERAL MEMORY READ/WRITE PROCEDURE 

GENERICTRAINING LOAD 

HARDWARE 

HIERARCHICAL STORAGE MANAGEMENT 

INTEGRATED BASELINE CONTROL BOARD 

INTERNATIONAL BUSINESS MACHINES 

INTEGRATED DISCREPANCY REVIEW BOARD 

ILOAD DATA SET 

INITIALIZATION LOAD 

INTERIM MASTER RECONFIGURATION BASE 

INFORMATION MANAGEMENT SYSTEM 

JOB ENTRY SUBSYSTEM 

JOHNSON SPACE CENTER 

KENNEDY SPACE CENTER 

LEVEL 6 DETAIL FUNCTIONAL TESTING 

LEVEL 7 CAPABILITIES PERFORMANCE TESTING 

LEVEL 8 RECONFIGURATION PERFORMANCE TESTING 

MEASUREMENT AND STIMULUS DATA BASE 

MISSION CONTROL CENTER 

MEMBER DATABASE INITIALIZATION 

MASS MEMORY INTEGRATION PLAN 

MASS MEMORY 

MASS MEMORY IMAGE 
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ACRONYMS 


MMU 

MOCRB 

MOD 

MODRB 

MRAS 

MRB 

MSFC 

MVS 

OASCB 

01 

ORG 

OSDR 

PASS 

PCO 

PCR 

PRCB 

PRN 

PSCR 

PSDR 

PSF 

R&E 

RASS 

RCV 

RECON 

RELAUTH 

Rl/D 

RM 


MASS MEMORY UNIT 

MISSION OPERATIONS CHANGE REVIEW BOARD 

MISSION OPERATIONS DIRECTORATE 

MISSION OPERATIONS DISCREPANCY REVIEW BOARD 

MAINTENANCE RELEASE AUTHORIZATION 

MASTER RECONFIGURATION BASE 

MARSHALL SPACE FLIGHT CENTER 

MULTIPLE VIRTUAL STORAGE 

ORBITER AVIONICS SOFTWARE CONTROL BOARD 

OPERATIONAL INCREMENT (BASE FSW SYSTEM) 

ORGANIZATION 

OPERATION SHUTTLE DATA RECONFIGURATION 

PRIMARY AVIONICS SOFTWARE SUBSYSTEM 

PATCH CUT-OFF 

PROGRAM CHANGE REQUEST 

PROGRAM REQUIREMENTS CONTROL BOARD 

PROGRAM RELEASE NOTICE 

PRODUCTION SOFTWARE CHANGE REQUEST 

PRODUCTION SOFTWARE DISCREPANCY REPORT 

PARAMETER SPECIFICATION FILE 

RESEARCH AND ENGINEERING 

RELEASE AUTHORIZATION SIGNATURE SHEET 

RECEIVING 

RECONFIGURATION (FLIGHT-TO-FLIGHT) 

RELEASE AUTHORIZATION 
ROCKWELL INTERN ATIONALyDOWNEY 
ROOM (AS IN FRONTROOM OR BACKROOM) 
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ACRONYMS 




RSD 

RSOC 

RT&O 

SAS 

SCCB 

SCR 

SDF 

SM 

SMP 

SPF 

SPIF 

SPT 

SRC 

SRR 

SSD 

SSDR 

STAR 

STS 

STSOC 

SWORS/W 

SYNVAT 

T&O 

TCT 

TR 

UAT 


RECONFIGURATION SYSTEMS 

ROCKWELL SHUTTLE OPERATIO^'COWPAW 

RECON TEST & OPERATIONS CONTROL BOARD) 

SOFTWARE APPROVAL SHEET 

SOFTWARE CONFIGURATION COWROTi fflOARO) 

SOFTWARE (CAPABILITY) CHANG?; REOUESJT 

SOFTWARE DEVELOPMENT FACIILW 

1. SYSTEM MANAGEMENT AS IN'SMFSW." 

2. SUBMIT TRANSACTION AS IN '‘SJUafWITPQOli. 
ELEMENT VIA SM TR ANS ACTI CNS IIUi I MS” 

SYSTEMS MANAGEMENT PREPROCESSOR* 

SOFTWARE PRODUCTION FACILITY 

SHUTTLE PAYLOAD INTEGRATION FACILITY 

SUPPORT 

SOURCE 

SOFTWARE READINESS REVIEW 

SPACECRAFT SOFTWARE DIVISION 

SUPPORT SOFTWARE DISCREPANCY RS.TORT 

SPACE TRANSPORTATION AUTOMATED* 
RECONFIGURATION 

SPACE TRANSPORTATION SYSTEM? 

SPACE TRANSPORTATION SYSTEM. OPERATIONS; 
CONTRACT 

SOFTWARE 

SYSTEM NAME VALIDATION TAB'iE3jFOR?SMDBi 

TEST & OPERATIONS 

TEST COORDINATION TEAM 

TRANSMITTAL RELEASE 

USER ACCEPTANCE TEST 
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ACRONYMS 


UPF 

VCS 


VLS 


UNIVERSAL PATCH FORMAT 
VEHICLE/CARGO SYSTEMS 
VANDENBERG LAUNCH SITE 
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EXTERNAL- EVALUATIONS or XB/H P&ocE^S 
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